Super-Exponential Solution in Markovian 
Supermarket Models: Framework and Challenge 



Quan-Lin Li 
School of Economics and Management Sciences 
Yanshan University, Qinhuangdao 066004, China 

January 28, 2011 
Abstract 

Marcel F. Neuts opened a key door in numerical computation of stochastic models 
by means of phase- type (PH) distributions and Markovian arrival processes (MAPs) . 
To celebrate his 75th birthday, this paper reports a more general framework of Marko- 
vian supermarket models, including a system of differential equations for the fraction 
measure and a system of nonlinear equations for the fixed point. To understand this 
framework heuristically, this paper gives a detailed analysis for three important su- 
permarket examples: M/G/l type, GI/M/1 type and multiple choices, explains how 
to derive the system of differential equations by means of density-dependent jump 
Markov processes, and shows that the fixed point may be simply super-exponential 
through solving the system of nonlinear equations. Note that supermarket models 
are a class of complicated queueing systems and their analysis can not apply popular 
queueing theory, it is necessary in the study of supermarket models to summarize such 
a more general framework which enables us to focus on important research issues. On 
this line, this paper develops matrix-analytical methods of Markovian supermarket 
models. We hope this will be able to open a new avenue in performance evaluation of 
supermarket models by means of matrix-analytical methods. 



Keywords: Randomized load balancing, supermarket model, matrix-analytic method, 
super-exponential solution, density-dependent jump Markov process, Batch Marko- 
vian Arrival Process (BMAP), phase- type (PH) distribution, fixed point. 
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1 Introduction 



In the study of Markovian supermarket models, this paper proposes a more general frame- 
work including a system of differential equations for the fraction measure and a system 
of nonlinear equations for the fixed point, and the both systems of equations enable us to 
focus on important research issues of Markovian supermarket models. At the same time, 
this paper indicates that it is difficult and challenging to analyze the system of differential 
equations and to solve the system of nonlinear equations from four key directions: Ex- 
istence of solution, uniqueness of solution, stability of solution and effective algorithms. 
Since there is a large gap to provide a complete solution to the both systems of equations, 
this paper devotes heuristic understanding of how to organize and solve the both systems 
of equations by means of discussing three important supermarket examples: M/G/l type, 
GI/M/1 type and multiple choices. Specifically, the supermarket examples show a key 
result that the fixed point can be super-exponential for more supermarket models. Note 
that supermarket models are a class of complicated queueing systems and their analysis 
can not apply popular queueing theory, while recent research gave some simple and beau- 
tiful results for special supermarket models, e.g., see Mitzenmacher |19j . Li and Lui 
and Luczak and McDiarmid [14], this motivates us in this paper to summarize a more 
general framework in order to develop matrix-analytical methods of Markovian supermar- 
ket models. We hope this is able to open a new avenue for performance evaluation of 
supermarket models by means of matrix-analytical methods. 

Recently, a number of companies, such as Amazon and Google, are offering cloud 
computing service and cloud manufacturing technology. This motivates us in this paper 
to study randomized load balancing for large-scale networks with many computational 
and manufacturing resources. Randomized load balancing, where a job is assigned to a 
server from a small subset of randomly chosen servers, is very simple to implement. It 
can surprisingly deliver better performance (for example reducing collisions, waiting times 
and backlogs) in a number of applications including data centers, distributed memory 
machines, path selection in computer networks, and task assignment at web servers. Su- 
permarket models are extensively used to study randomized load balancing schemes. In 
the past ten years, supermarket models have been studied by queueing theory as well as 
Markov processes. Since the study of supermarket models can not apply popular queueing 
theory, they have not been extensively studied in queueing committee up to now. There- 
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fore, this leads to that available queueing results of supermarket models are few up to 
now. Some recent works dealt with the supermarket model with Poisson arrivals and ex- 
ponential service times by means of density-dependent jump Markov processes, discussed 
limiting behavior of the supermarket model under a weakly convergent setting when the 
population size goes to infinite, and indicated that there exists a doubly exponential so- 
lution to the fixed point through solving the system of nonlinear equations. Readers may 
refer to population processes by Kurtz [8], and doubly exponential solution with exponen- 
tial improvement by Vvedenskaya, Dobrushin and Karpelevich [27J, Mitzenmacher [19J, 
Li and Lui [11] and Luczak and McDiarmid [14] . 

Certain generalization of supermarket models has been explored in, for example, study- 
ing simple variations by Vvedenskaya and Suhov [28] . Mitzenmacher |20| . Azar, Broder, 
Karlin and Upfal [I], Vocking [26], Mitzenmacher, Richa, and Sitaraman |22] and Li, Lui 
and Wang [13J ; considering non- Poisson arrivals or non-exponential service times by Li, 
Lui and Wang [12], Li and Lui [11], Bramson, Lu and Prabhakar [2] and Li [10] ; dis- 
cussing load information by Mirchandaney, Towsley, and Stankovic [23], Dahlin [3 J and 
Mitzenmacher |21j : mathematical analysis by Graham [U [5j [6], Luczak and Norris |16] 
and Luczak and McDiarmid [141 115] : using fast Jackson networks by Martin and Suhov 
[18] . Martin [17] and Suhov and Vvedenskaya [25] , 

The main contributions of the paper are twofold. The first one is to propose a more 
general framework for Marovian supermarket models. This framework contains a system 
of differential equations for the fraction measure and a system of nonlinear equations 
for the fixed point. It is indicated that there exist more difficulties and challenges for 
dealing with the system of differential equations and for solving the system of nonlinear 
equations because of two key factors: infinite dimension and complicated structure of 
nonlinear equations. Since there is still a large gap up to being able to deal with the both 
systems of equations systematically, the second contribution of this paper is to analyze 
three important supermarket examples: M/G/T type, GI/M/1 type and multiple choices. 
These examples provide necessary understanding and heuristic methods in order to discuss 
the both systems of equations from practical and more general point of view. For the 
supermarket examples, this paper derives the systems of differential equations for the 
fraction measure by means of density-dependent jump Markov processes, and illustrates 
that the fixed points may be super-exponential through solving the systems of nonlinear 
equations by means of matrix-analytic methods. 
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The remainder of this paper is organized as follows. Section 2 proposes a more general 
framework for Markovian supermarket models. This framework contains a system of 
differential equations for the fraction measure and a system of nonlinear equations for 
the fixed point. In Sections 3 and 4, we consider a supermarket model of M/G/l type 
by means of BMAPs and a supermarket model of GI/M/1 type in terms of batch PH 
service processes, respectively. For the both supermarket models, we derive the systems 
of differential equations satisfied by the fraction measure in terms of density-dependent 
jump Markov processes, and obtain the system of nonlinear equations satisfied by the fixed 
point which is shown to be super-exponential. In Section 5, we analyze two supermarket 
models with multiple choice numbers, and give super-exponential solution to the fixed 
points for the two supermarket models. Note that the supermarket examples discussed in 
Sections 3 to 5 can provide a heuristic understanding for the more general framework of 
Markovian supermarket model given in Section 2. 



2 Markovian Supermarket Models 

In this section, we propose a more general framework for Markovian supermarket models. 
This framework contains a system of differential equations for the fraction measure and a 
system of nonlinear equations for the fixed point. 

Recent research, e.g., see Mitzenmacher |20| and Li and Lui shows that a Marko- 
vian supermarket model contains two important factors: 

(1) Continuous-time Markov chain Q, called stochastic environment of the supermarket 
model; and 

(2) Choice numbers, including input choice numbers d\, (fa, ■ ■ ■ , d v and output choice 
numbers /i, /2, . . . , f w . Note that the choice numbers determine decomposed structure of 
the stochastic environment Q. 

We first analyze stochastic environment of the Markovian supermarket model. From 
point of view of stochastic models, we take a more general stochastic environment which 
is a continuous-time Markov chain {Xt,t > 0} with block structure. We assume that the 
Markov chain {Xt,t > 0} on state space = {(k,j) : k > 0, 1 < j < m^} is irreducible 
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and positive recurrent, and that its infinitesimal generator is given by 



/ 
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(1) 



where Qij is a matrix of size rrii x rrij whose (r, r')th entry is the transition rate of the 
Markov chain from state (i, r) to state (j, r'). It is well-known that Qij > for i / j, Qi^ 
is invertible with strictly negative diagonal entries and nonnegative off-diagonal entries. 
For state (i, k), i is called the level variable and k the phase variable. We write level i as 
Li = {(i, k) : 1 < k < rrii}. 

Since the Markov chain is irreducible, for each level i there must exist at east one left- 
block state transition: «— level i or level i and at east one right-block state transition: 
— > level i or level i — >. We write 



©left = {<— level i or level i <— : level i G ft} 



and 



-bright = {— ^ l eve l i or level i — >: level i G fl} . 
Note that E\ e & and -©right describe output and input processes in the supermarket model. 



Based on the two block-transition sets E\ e ^ and -E^ght, we write 

Q = Qleft + Qright; 



(2) 



and for i > 



Thus we have 
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Note that Qe = 0, Qiefte = and Qrighte = 0, where e is a column vector of ones with a 
suitable dimension in the context. We assume that the matrices Qk ft for j > 1 and Q" ght 
for i > are all invertible, while Q l is possibly singular if there is not an output process 
in level 0. We call Q = Q\ e {t + Qright an input-output rate decomposition of the Markovian 
supermarket model. 

Now, we provide a choice decomposition of the Markovian supermarket model through 
decomposing the two matrices Qi e ft and Q right- Note that the choice decomposition is based 
on the input choice numbers d±, d,2, ■ ■ ■ , d v and the output choice numbers /i, /2, • • • , /to- 
We write 

Qlcft = Qkft (/l) + Qlcft {f2) H 1" Qlcft (/«)) (3) 

for the output choice numbers /1, /2, . . . , f w , and 

Qright = Qright (^l) + Qright (^2) + • • • + Qright {dv) (4) 

for the input choice numbers d\, d,2, ■ ■ ■ , d v . 

To study the Markovian supermarket model, we need to introduce two vector notation. 
For a vector a = (01, 02, 03, . . .), we write 

a Qd = (4,4,4,..) 

and 



1 

,J 1 j "2 ' a 3 ' • • • 



Let S (t) = (So (t) , S\ (t) , S2 (t) , . . .) be the fraction measure of the Markovian su- 
permarket model, where Si (t) is a row vector of size nii for i > 0. Then S (t) > and 
So (i) e = 1. Based on the input-output rate decomposition and the choice decomposition 
for the stochastic environment, we introduce the following system of differential equations 
satisfied by the fraction measure S (t) as follows: 



S (t) > and So (t) e = 1, (5) 

and 

dt 



, TO V 

-S (t) = S &f ' (t) Qleft (fl) + E ^ (*) ^"ght (4) • (6) 



Z=l fc=l 

In the Markovian supermarket model, a row vector ir = (no, tti, TT2, ■ ■ •) is called a fixed 
point of the fraction measure S (t) if lim t „i. +00 S 1 (£) = tt. In this case, it is easy to see that 

d 



lim 

t— >+oc 



0. 
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If there exists a fixed point of the fraction measure, then it follows from ([5]) and ([6]) 
that the fixed point is a nonnegative non-zero solution to the following system of nonlinear 
equations 

7To > and 7Toe = 1, (7) 

and 

W V 

^ Q/i Qieft (fl) + ^QmU (4) = 0. (8) 

1=1 k=l 

Remark 1 J/ 4 = 1 for 1 < k < v and fi = 1 for 1 < I < w, then the system of 
differential equations (EP and ^ is given by 

S (t) > and S (t) e = 1, 

and 

l S (t) = S(t)Q. 

Thus we obtain 

S (t) = cS (0) exp {Qt} . 

Let 

W (t) = (Wo (t) , W l (t) ,W 2 (t),...) = S (0) exp {Qt} , 

where Wi (t) is a row vector of size rrij for i > 0. Then S (t) = cW (t) , where c = 
1/Wo (t)e. At the same time, the system of nonlinear equations ([?[) and (0j is given by 

7To > and noe = 1, 

and 

ttQ = 0. 

Let W = (wo, wi, u>2, . . .) be the stationary probability vector of the Markov chain Q, where 
Wi is a row vector of size mi for i > 0. Then tt = cW , where c = 1/woe. Note that the 
stationary probability vector W of the block-structured Markov chain Q is given a detailed 
analysis in Chapter 2 of Li by means of the RG -factorizations. 

If there exist some df. > 2 or/and // > 2 in the Markovian supermarket model, then 
the system of differential equations ([5]) and ([6]) and the system of nonlinear equations ([7]) 
to (|8|) are two decomposed power-form generalizations of transient solution and of sta- 
tionary probability of an irreducible continuous-time Markov chain with block structure 
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(see Chapters 2 and 8 of Li [9]). Note that Li [9] can deal with transient solution and 
stationary probability for an irreducible block-structured Markov chain, where the RG- 
factorizatons play a key role. However, the RG-factorizatons can not hold for Markovian 
supermarket models with some dj~ > 2 or/and f\ > 2. Therefore, there exist more dif- 
ficulties and challenges to study the system of differential equations ([5]) and © and the 
system of nonlinear equations © to (|8j) . Specifically, it still keeps not to be able to answer 
four important issues: Existence of solution, uniqueness of solution, stability of solution 
and effective algorithms. This is similar to some research on the four important issues of 
irreducible continuous-time Markov chains with block structure. 

In the remainder of this paper, we will study thee important Markovian supermarket 
examples: M/G/l type, GI/M/1 type and multiple choices. Our purpose is to provide 
heuristic understanding of how to set up and solve the system of differential equations (|5j) 
and ([6]) , and the system of nonlinear equations ((TJ) to dH])- 

3 A Supermarket Model of M/G/l Type 

In this section, we consider a supermarket model with a BMAP and exponential service 
times. Note that the stochastic environment is a Markov chain of M/G/l type, the 
supermarket model is called to be of M/G/l type. For the supermarket model of M/G/l 
type, we set up the system of differential equations for the fraction measure by means of 
density-dependent jump Markov processes, and derive the system of nonlinear equations 
satisfied by the fixed point which is shown to be super-exponential solution. 

The supermarket model of M/G/l type is described as follows. Customers arrive 
at a queueing system of n > 1 servers as a BMAP with irreducible matrix descriptor 
(nC, nDi,nD2,nD^, . . .) of size to, where the matrix C is invertible and has strictly nega- 
tive diagonal entries and nonnegative off-diagonal; > is the arrival rate matrix with 
batch size k for k > 1. We assume that Y^=i ^D^ is finite and that C + J2T=i ®k is 
an irreducible infinitesimal generator with (C + X/SbLi ^fc) e = 0. Let 7 be the stationary 
probability vector of the irreducible Markov chain C + ^fc^i-^fc- Then the stationary 
arrival rate of the BMAP is given by nX = njYl^i kD^e. The service times of each cus- 
tomer are exponentially distributed with service rate fj,. Each batch of arriving customers 
choose d > 1 servers independently and uniformly at random from the n servers, and 
joins for service at the server which currently possesses the fewest number of customers. 
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If there is a tie, servers with the fewest number of customers will be chosen randomly. 
All customers in every server will be served in the first-come- first service (FCFS) manner. 
We assume that all the random variables defined above are independent of each other and 
that this system is operating in the region p = X/p, < 1. Clearly, d is an input choice 
number in this supermarket model. Figure 1 is depicted as an illustration for supermarket 
models of M/G/l type. 



BMAP 

(nC.nD,, «£>.,,...) 

Each batch of customers 
Probe d servers 



2 _ 



; 

'--^ d-l 

^ / 




rzzi 




Figure 1: A supermarket model of M/G/l type 



The supermarket model with a BMAP and exponential service times is stable if p = 
X/p < 1. This proof can be given by a simple comparison argument with the queueing 
system in which each customer queues at a random server (i.e., where d = 1). When d = 1, 
each server acts like a BMAP/M/1 queue which is stable if p = X/p < 1, see chapter 5 in 
Neuts [24] . Similar to analysis in Winston [30] and Weber [29] . the comparison argument 
leads to two useful results: (1) the shortest queue is optimal due to the assumptions on 
a BMAP and exponential service times in the supermarket model; and (2) the size of the 
longest queue in the supermarket model is stochastically dominated by the size of the 
longest queue in a set of n independent BMAP/M/1 queues. 

We define nl (t) as the number of queues with at least k customers, including cus- 
tomers in service, and with the BMAP in phase i at time t > 0. Clearly, < nl (t) < n 
for k > and 1 < i < m. Let 

4 l) (M) = ^, 

n 



which is the fraction of queues with at least k customers and the BMAP in phase i at 
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time t > for k > 0. We write 

X n (k, t) = (^Xn ^ (k, t) , x^ (k, t) , . . . , x^ ^ (k, t t 
for k > 0, and 

X n (t) = (X n (0,t),X n (l,t),X n (2,t),...). 

The state of the supermarket model may be described by the vector X n (t) for t > 0. 
Since the arrival process to the queueing system is a BMAP and the service time of each 
customer is exponential, the stochastic process {X n (t) ,t > 0} is a Markov process whose 
state space is given by 



={{9^,9^,9^ ...): 9^ is a probability vector, gW > > 

for k > 1, and ng$ is a vector of nonnegative integers for I > 0}. 



Let 



and 



sf (n,t) = E\x%' (n,t) 
S k (n, t) = (4 (n, t) , 4 2) (n, i) , . . . , (n, t) 



for fc > 0, 



5 (n, i) = (5 (n, i) , Si (n, t) , S 2 (n, *),...)• 



As shown in Martin and Suhov [18] and Luczak and McDiarmid [14] . the Markov process 
{X n (t) ,t > 0} is asymptotically deterministic as n — > oo. Thus lim^^oo E x, (n, t) 
always exist by means of the law of large numbers for k > 0. Based on this, we write 

S k (t) = lim Sk (n, t) 

n— >oo 

for k > 0, and 

S(t) = (S (t),S 1 (t),S 2 (t),...). 

Let X (t) = lim n^-oo X n (t). Then it is easy to see from the BMAP and the exponential 
service times that {X (t) ,t > 0} is also a Markov process whose state space is given by 

= {(V 0) ,c/ (1) , 5 (2) , . . .) : g (0) is a probability vector, g {k) > g {k+l) > for k > l} . 

If the initial distribution of the Markov process {X n (t) ,t > 0} approaches the Dirac delta- 
measure concentrated at a point g € f2, then X (t) = lim^^oo X n (t) is concentrated on 
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the trajectory S g = {S (t) : t > 0}. This indicates a law of large numbers for the time 
evolution of the fraction of queues of different lengths. Furthermore, the Markov process 
{X n (t) ,t> 0} converges weakly to the fraction vector S (t) = (So (t) , Si (t) , S2 (t) , . . .) 
as n 00, or for a sufficiently small e > 0, 



where ||a|| is the Loo-norm of vector a. 

In what follows we set up a system of differential vector equations satisfied by the 
fraction vector S (t) by means of density-dependent jump Markov processes. 

We first provide an example to indicate how to derive the differential vector equations. 
Consider the supermarket model with n servers, and determine the expected change in 
the number of queues with at least k customers over a small time interval [0, (it). The 
probability vector that an arriving customer joins a queue with k — 1 customers in this 
time interval is given by 



since each arriving customer chooses d servers independently and uniformly at random 
from the n servers, and waits for service at the server which currently contains the fewest 
number of customers. Similarly, the probability vector that a customer leaves a server 
queued by k customers in this time interval is given by 



lim P{\\X n {t)-S(t)\\>e} = 0, 



Si" 1 (n, t) D k + Sf d (n, t) LVi + "' + S^ 1 (n, t) D 1 + Sf (n, t) C ■ ndt 



[-fj>S k (n, t) + /uSfc+i (n, t)} ■ ndt. 



Therefore, we obtain 



rfc-i 



dE [n k (n, t)] 



Sf d (n, t) D k _i + Sf d (n, t) C ■ ndt 



11=0 



+ [-fiS k (n, t) + fiSk+i (n, t)} ■ ndt. 



This leads to 




fc-i 



dt 




n, t) D k ^i + S° d (n, t)C+ -fiS k (n, t) + fiS k+1 (n, t) . (9) 



1=0 



Since 




always exists for k > 0, taking n — > 00 in both sides of 



Equation ([9]) we can easily obtain 




(10) 
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Using a similar analysis to that in Equation (jlOp . we obtain the system of differential 
vector equations for the fraction vector S (t) = (So (t) , S\ (t) , . . .) as follows: 



S o (t)>0,S o (t)e = l, 



-5o(t) = 5 o 0d (t)C + / i5 1 (t) 



(11) 
(12) 



and for k > 1 



fc-i 



-S fc (t) = J] Sf d (n, t) D k _ x + Sf (n, t)C - fiS k (n, t) + »S k+1 (n, t) . (13) 



1=0 



Let 7r be the fixed point. Then tt satisfies the following system of nonlinear equations 



7T > 0,7r e = 1, 

%% d C + nm = o 



and for k > 1, 



Let 



fc-i 



*f + nfC - fXTT k + /iTTfe+l = 0. 



1=0 



Qright 



C D 1 D 2 D 3 D 4 

C £>i D 2 D 3 

C Di D 2 

C Di 



and 



V 

/ 

fil —fj,I 

fil —\xl 

\ 

Then the system of differential vector equations is given by 



Qioft 



\ 



5 (t)>0,5 (t)e = l, 



and 



S(t) = S Gd (t)Q right + S(t) QMt, 



dt 



(14) 
(15) 

(16) 



12 



and the system of nonlinear equations (fbi|) to (fT6|) is given by 



and 



7T > 0,7r e = 1, 



7T 0d Qright + TTQleft 



Remark 2 For the supermarket model with a BMAP and exponential service times, its 
stochastic environment is a Markov chain of M/G/l type whose infinitesimal generator 
is given by Q = Qi e ft + Qright- This example clearly indicates how to set up the system 
of differential equations |5|) and for the fraction measure and the system of nonlinear 
equations ^ to |2P for the fixed point. 



In the remainder of this section, we provide a super-exponential solution to the fixed 
point 7r by means of some useful relations among the vectors ir^ for k > 0. 
It follows from ([TBI) that 



Qd Qd Qd 
7T 1 , 7T 2 , 7T 3 , 
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C D x 
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(17) 
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Note that 
/ 



D D 1 D 2 
Do 



\ 



-A' 



and 

yir Q Di,tt D 2 ,7r Lt 3 , ., 
it follows from (JT7J) that 



-A 



-IN 



/ oo oo oo 

/ J E A J E A J E D k 

^ k=0 k=l k=2 

oo oo oo 

jea 

^ fc=0 fc=0 fc=l 

oo oo oo 

JEA JEA ±EA 

^ k=0 k=0 k=0 
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and for k > 2, 



k-i 



0ci 



i=0 



_. oo 



_. oo 

7 E D » 



■£«f 



^ oo 



^ j=k-i 



j=k 



1 oo 

it 

^ i=0 



(18) 



(19) 



To omit the terms Ej=fc 



oo 
P i=0 



oo 0d 

equations (fTHj) and (fl~9|) has a closed-form solution 

7r fc = r (k) 7°^ 



for > 1, we assume that the system of nonlinear 



(20) 



where r (k) is an underdetermined positive constant for k > 1. Then it follows from fll8|) . 
(USD and (Ha that 



or 



r (1) 7 °3 = 7r{f d 
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'E D 

i=l 
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(21) 
(22) 



and for k > 2, 



or 
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i 00 
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(23) 



14 



Let 9 = l/j & <ie. Then < 9 < 1. Let = 7Ei=fc Ae an d Pk = Then it follows 

from (j22J) and ^2HJ) that 



rl) 



-7T, 



0(Z 



(24) 



and for k > 2 



fc-l 



oo 



fc-l 



j=k-i 



id 



«JJ Pfc-i- 



(25) 



j=fc i=i 

It is easy to see from (|24p and f|25[) that 7ro and r (1) are two key underdetermined terms 
for the closed- form solution to the system of nonlinear equations (|22p and f|23|) . Let us 
first derive the vector ttq. It follows from (|15p and (|2ip that 

7r© d C + ^vri = 0, 

oo 

w = *o d £ A- 

i=l 



This leads to 



i=l 



Thus, it is easy to see that 7ro = ^7° d , which is a probability vector with ttqc = 1. Hence 
we have 



7Ti = 7C = —7 V] A- 



(26) 



It follows from OD and (1251) that 



and for k > 2 



r(l) = --^VAe=9%i 



i=i 



„ 00 „ fc— 1 00 

w = ^o 0d E^ e +^E^«]^ E 

j=k i=l j=k—i 

fc-l 

= d +V*+0E>(i)] d p fc -i- 
i=l 



(27) 



(28) 



Therefore, we obtain the super-exponential solution to the fixed point as follows: 



7Tq = #7 W d 
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and for k > 1 

k-1 



7 ®i 



4 A Supermarket Model of GI/M/1 Type 

In this section, we analyze a supermarket model with Poisson arrivals and batch PH service 
processes. Note that the stochastic environment is a Markov chain of GI/M/1 type, thus 
the supermarket model is called to be of GI/M/1 type. For the supermarket model of 
GI/M/1 type, we set up the system of differential equations for the fraction measure by 
means of density-dependent jump Markov processes, and derive the system of nonlinear 
equations satisfied the fixed point which can be computed by an iterative algorithm. 
Further, it is seen that the supermarket model of GI/M/1 type is more difficult than the 
case of M/G/l type. 

Let us describe the supermarket model of GI/M/1 type. Customers arrive at a queue- 
ing system of n > 1 servers as a Poisson process with arrival rate nX for A > 0. The 
service times of each batch of customers are of phase type with irreducible representation 
(a, T) of order m and with a batch size distribution {bk, k = 1, 2, 3, . . .} for &fc = 1 

and b = J2k=i ^fc < +°°- Let T° = — Te ^ 0. Then the expected service time is given 
by 1/fi = —aT~ 1 e = r)T°, where i] is the stationary probability vector of the Markov 
chain T + T°a. Each batch of arriving customers choose d > 1 servers independently 
and uniformly at random from the n servers, and waits for service at the server which 
currently contains the fewest number of customers. If there is a tie, servers with the fewest 
number of customers will be chosen randomly. All customers in every server will be served 
in FCFS for different batches and in random service within one batch. We assume that 
all random variables defined above are independent of each other, and that the system 
is operating in the stable region p = X/fib < 1. Clearly, d is an input choice number in 
this supermarket model. Figure 2 is depicted as an illustration for supermarket models of 
GI/M/1 type. 

We define nj? (t) as the number of queues with at least k customers and the service 
time in phase i at time t > 0. Clearly, < n$ (t) < n for k > 1 and 1 < i < m. Let 



x<°> (t) = l = 1, 
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Poisson arrivals 



Each customer 
Probes servers 



2 . 



cl-l 
d 



^ Batch PH 

Server \ service 

Ty ' 

f ~N Batch PH 
Server \ service 
1 I * 



f ~ , Batch PH 
Server \ service 
3 J * 



y- X Batch PH 

Server \ service 



Figure 2: A supermarket model of GI/M/1 type 



and k > 1 



which is the fraction of queues with at least k customers and the service time in phase % 
at time t > 0. We write 

X™ (t) = (x^ (t) , (t) , . . . , x^ it)) , k > 1, 
x n (t) = (xM ( t ),xW ( t ),xP (t),. 



The state of the supermarket model may be described by the vector X n (t) for t > 0. Since 
the arrival process to the queueing system is Poisson and the service times of each server 
are of phase type, {X n (t) ,t > 0} is a Markov process whose state space is given by 

and ng^ is a vector of nonnegative integers for k > 1}. 



Let 



and k > 1 



so (n,t) = E\x^ (t) 



4 i} (n,t) = sta^) (t) 



Clearly, so (n,t) = 1. We write 

5 fc (n, t) = (4 X) (n, t) , 4 2) (n, t) , . . . , (n, t)) , k > 1. 
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As shown in Martin and Suhov [18] and Luczak and McDiarmid [14], the Markov pro- 
symptotically deterministic as n — > oo. Thus linin^oo E Xn (t) 
always exist by means of the law of large numbers. Based on this 

S (t) = lim s (n,t) = 1, 



and linin^oo E 



we write 



X, 



(k,i) 



for k > 1 



4 ] n) 



lim sjr (n, t) , 



S fc (i) 



(t),...,.<™>(t) 



and 



5(t) = (5 (t),5i (t),S 2 (£),...). 



Let X (t) = lim 

n— voo X n (t) . Then it is easy to see from Poisson arrivals and batch PH 
service times that {X (t) ,t> 0} is also a Markov process whose state space is given by 



n 



{^ \g^, 9 ^\...):g^ = l,9^>g^>0}. 



If the initial distribution of the Markov process {X n (£),£> 0} approaches the Dirac 
delta-measure concentrated at a point g £ Q, then its steady-state distribution is con- 
centrated in the limit on the trajectory S g = {S (t) : t > 0}. This indicates a law of 
large numbers for the time evolution of the fraction of queues of different lengths. Fur- 
thermore, the Markov process {X n (t) ,t > 0} converges weakly to the fraction vector 
S (t) = (So (t) , S\ (t) , 5*2 (t) , . . .), or for a sufficiently small e > 0, 

lim P{\\X n (t)-S(t)\\>e} = 0, 

n— >oo 

where ||a|| is the Loo-norm of vector a. 

To determine the fraction vector S (t) , we need to set up a system of differential vector 
equations satisfied by the fraction measure S (t) by means of density-dependent jump 
Markov processes. Consider the supermarket model with n servers, and determine the 
expected change in the number of queues with at least k customers over a small time 
period of length dt. The probability vector that during this time period, any arriving 
customer joins a queue of size A; — 1 is given by 



n 



(n,t)-\S% d (n,t) 



Qd 



dt. 
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Similarly, the probability vector that a customer leaves a server queued by k customers is 
given by 

oo 

^ dt. 



11 



S k (n, t)T + kSk+i (n, t) T°a 
1=1 

Therefore, we obtain 

dE [n k (n, t)\ =n \XS^ (n, t) - XS® d (n, t)] dt 



+ n 



Sk (n, t)T + hSk+i in, t) T°a 



i=i 



dt. 



This leads to 

dS k (n, t) _ &d 



dt 



AS£i [n, t) - XSf (n, t) + S k (n, t) T + ]T kS k+l (n, t) T°a. (29) 



l=i 



Taking n — > oo in both sides of Equation (|29p . we have 

= AS®^ (t) - XS° d (t) + S k (t)T + jr hS k+l (n, t) T°a. 



(30) 



i=i 



Using a similar analysis to Equation (|30p . we obtain a system of differential vector 
equations for the fraction vector S (t) = (Sq (t) , S\ (t) , S-2 (t) , . . .) as follows: 



dt 



So (t) = 1, 



S (t) = -XS d (t) + f> (t) T° h 



i=i 



k=l 

oo 



-Si (t) = XaS d (t) - XSf d (t) + S 1 (t)T + Y J kSi+i (t) T°a, 



i=i 



and for k > 2, 



dt 



S k (*) = AS®^ (t) - XSf (t) + S k (t)T + J2 biS k+l (t) T°a. 



(31) 
(32) 

(33) 
(34) 



i=i 



If the row vector n = (ttq, tti, tt2, • • •) is a fixed point of the fraction vector S (t), then 
the fixed point tt satisfies the following system of nonlinear equations 



7T = 1 

oo oo 



(35) 
(36) 



1=1 k=l 
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Acraff - Avrf d + vriT + k^i+iT°a = 0, 



and for k > 2, 



Let 



Avr®^ - Xirf d + ir k T + ]T 6/7r fe+i T°a = 0. 



(37) 



(38) 



Qright 



1=1 

-A Act 

-A/ XI 

-XI XI 

-XI XI 



and 



Qlcft 



V 

( o 

OO 

k=2 

oo 

T° £ b k b 2 T°a 6iT°a T 

oo 

T° £ ft fe &3^ a b 2 T°a &iT°a T 

fc=4 



V 



Then the system of differential vector equations for the fraction measure is given by 

So (t) = 1, 

and 



dt 



S(t) = S &d (t)Q right + S(t) Qi eft ; 



and the system of nonlinear equations for the fixed point is given by 



tto = 1, 



and 



vr 0d Q ri ght + TrQieft = 0. (39) 

In the remainder of this section, we provide an iterative algorithm for computing the 
fixed point for the supermarket model of GI/M/1 type. Specifically, the iterative algorithm 
indicates that the supermarket model of GI/M/1 type is more difficult than the case of 
M/G/l type. 
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Let 



B 



\ 



-XI XI ••• ^ 

-XI XI ■■■ 
-XI ••• 



and 



( T 

6iT°a T 

Qservice = b 2 T°a b\T°a T 

b 3 T°a b 2 T°a &iT°a T 

{ ; ; • 

Then it follows from (I39D that 

tt^ (Aa, 0, 0, 0, . . .) + tt| d B + 7r £ Q s crvici 
where ire = (^1,^2,^3, • • •)• Note that 



\ 



0. 



/ I 



(-BY 



-I ij ij 
A J A J A J 



■ j 



using ttq = 1 we obtain 



and 



Q service ( 



1 1 



vr^ (Aa, 0, 0, 0, . . .) (-£) 1 = (a, a, a, . . .) 

T T T T 

(T°a) 61 T + (T°a) 61 T + (T°a) 61 T + (T°a) 61 

(T°a) 6 2 (T°a) E b k T + (T°a) E 6 fc T + (T°a) E 6, 

fc=i fc=i fc=i 

(T°a) 63 {T°a) E b k (T°a) E 6 fc T + (T°a) E 6, 



fe=2 



fc=l 



V 



Thus it follows from (|40p that 

vr® d = ^ (Aa, 0, 0, 0, . . .) (-S)- 1 + vr £ Q se 
= (a, a, a, . . .) + 7r,cQ service (-By 1 . 



-By 1 
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This leads to that for k > 1 

fc+l fc+2 fc+3 

Xn d = Xa + Y^^T + b^ n {T°a) + 6 2 vr, (T°a) + 



(41) 



Z=l Z=2 Z=3 

To solve the system of nonlinear equations (|4ip for A; > 1, we assume that the fixed point 
has a closed-form solution 

ir k = r (k) r], 

where rj is the stationary probability vector of the Markov chain T + T°a. It follows from 
HUD that 

fc+l fc+2 fc+3 

Xr d (k) V Qd = Xa + ^r (I) r,T + 6i ^ r (Z) r? (T°a) + b 2 ^r(l)r] [T°a) + ■■■ . 

1=1 1=2 1=3 

Taking 9 = r/ 0d e. Then 9 € (0, 1). Noting that ae = 1, rfTe = —\i and 7]T° = fi, we obtain 
that for k > 1 

fc+l fc+2 fc+3 

p^(Ai) = p -^ r (Z) + 6 1 ^ r (/) + 6 2 ^ r (Z) + ... . (42) 



z=i 



1=2 



1=3 



This gives 



(43) 



P 9 r d (k) - r d (k + 1) = r {k + 2) - ^ b x r (k + 2 + I) . 

1=1 

Thus it follows from (|43p that 

^ (> (1) - r ^ (2) , r d (2) - r d (3) , r d (3) - r d (4) , . . .) = (r (3) , r (4) , r (5) , . . .) C, (44) 



where 



/ 1 



C 



\ 



-h 1 

-b 2 -h l 
-6 3 -6 2 -61 1 



Therefore, we have 
/ 



c- 1 



1 

h 

b 2 + b\ 
63 + 26 2 6i + 6? 



\ 



1 

bi 
b 2 + b\ 



1 

61 



64 + 26361 + 36 2 6? + bj 63 + 26261 + 6? 6 2 + 6? 61 1 



V 
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and the norm || • of the matrix C 1 is given by 

oo 

\\C- X \\ = sup {\(i, j \}<Y / b k = l, 

i>3>l t^i 

where Qj is the (i,j)th entry of the matrix C _1 for < j < i. Note that the norm 
||C _1 || < 1 is useful for our following iterative algorithm designed by the matrix pOC^ 1 
with \\p9C- l \ \ = p9 < 1. 
Let 

X = (r d (1) - r d (2) , r d (2) - r d (3) , r d (3) - r d (4) , . . .) 

and 

y=(r(3),r(4),r(5),...). 

Then 

X = (r d (1) , r d (2) , y 0d ) - (r d (2) , Y 0d ) 
and it follows from (1441) that 



y = x {pec- 1 ) 

= (r d (1) , r d (2) , Y 0d ) (p^C- 1 ) - (r d (2) , Y 0a! ) (p^ 1 ) . 



It follows from (021) that 



(45) 



r (1) = p - P 9r d (1) - r (2) (1 - fc) + Y (h + 6 2 , b 2 + b 3 , b 3 + h, . . .) T (46) 



and 



r (2) = p-r (1)- hr (2) + p#r d (2) +Y (h + b 2 -l,b 1 + b 2 + b 3 , b 2 + b 3 + 6 4 , • • • ) (47) 



Now, we use Equations (|45l) to (|47p to provide an iterative algorithm for computing 
the fixed point tt^ = r (k) r] for k > 1. To that end, we write 



*jv = (r N (S),r N (4),rjv (5),...) 



(48) 



and 



fljv = (r* (1) , rjv (2) , r w (3) , . . .) = {r N (1) , r N (2) , Y N ) 



(49) 
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Let 



r N+1 (1) =p - P 6r d N (1) - r N (2) (1 - &i) 

+ Y N (h + b 2 , b 2 + b 3 , h + 64, • • -) T , (50) 

r N+1 (2) =p - r N (1) - [bir N (2) + P 9r d N (2) 

+ y w (61 + b 2 - 1, h + b 2 + 63, o 2 + & 3 + b4, • • -) T (51) 

= (4 (1) , r% (2) , Y° rf ) (p9C-') - (r% (2) , Y° d ) (pOC- 1 ) . (52) 



and 



Based on the iterative relations given in (I50p to (J52J) , we provide an iterative algorithm 
for computing the vector R = (r (1) , r (2) , r (3) , . . .). This gives the fixed point ir = 
(l,r (1)77,7- (2)r/, r (3)77, ...)■ 

An Iterative Algorithm: Computation of the Fixed Point 

Input: A, (a, T) , {bk} and d 

Output : i? = (r (1) , r (2) , r (3) , . . .) and ir = (1, r (1) r/, r (2) r/, r (3) r/, . . .). 
Computational Steps: 

Step one: Taking the initial value Rq = 0, that is, ro (1) = 0, ro (2) = 0, Yq = 0. 
Step two: Computing Ri = (r\ (1) , r\ (2) , Y\) through 



ri (1) = p, <- USD} 

n (2) = p, <- dsm 

Ki = (/, P d , 0) (p^c- 1 ) - (/, 0) {pec- 1 ) , <- m 



Step three: If Rn is known, computing Rn+i = (nv+i (1) j^jv+i (2) , Y/v+i) through 

r^+x (1) = p - P er d N (1) - r N (2) (1 - 6 X ) 

+ Fjv (61 + b 2 , b 2 + 63, h + 64, • • • ) , 
r N+1 (2) = p- r N (1) - [bir N (2) + p^ (2)] ^ 

+ yjv (61 + b 2 - 1, 61 + b 2 + 63, 62 + 03 + 64, • • -) T , 
Y N+l = (r d N (1) , r% (2) , Y° d ) (p^- 1 ) - (r& (2) , Y° d ) (p^ 1 ) . <- 452} 

S^ep /our; For a sufficiently small e > 0, if there exists Step If such that — 
Rk\\ < s, then our computation is end in this step; otherwise we go to Step three for 
continuous computations. 
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Step five: When our computation is over at Step K, computing 



7T = (1, r K (1) 7], r K (2) 77, r K (3) 77, . . .) 



as an approximate fixed point under an error e > 0. 

In what follows we analyze two numerical examples by means of the above iterative 
algorithm. 

In the first example, we take 



X = l,d = 2,a = (1/2,1/2) 



T(l) 



-4 3 



,T(2) 



-5 3 



,T(3) 



-4 4 

2-7 1 \ 2 -7 I \ 2 -7 

Table [T] illustrates how the super-exponential solution (7Ti to 715) depends on the matrices 
T(l), T (2) and T(3), respectively. 

Table 1: The super-exponential solution depends on the matrix T 





T(l) 


T(2) 


T(3) 


7T1 


(0.2045, 0.1591) 


(0.1410, 0.1026) 


(0.3125, 0.2500) 


7T2 


(0.0137, 0.0107) 


(0.0043, 0.0031) 


(0.0500, 0.0400) 


7T3 


(6.193e-05, 4.817c-05) 


(3.965c-06, 2.884e-06) 


(0.0013 , 0.0010) 


7T4 


(1.259e-09, 9.793c-10) 


(3.390c-12, 2.465c-12) 


(8.446e-07, 6.757c-07) 


T5 


(5.204e-19, 4.048c-19) 


(2.478c-24, 1.802e-24) 


(3.656e-13, 2.925c-13) 



In the second example, we take 

X = l,d = 5,a(l) = (1/3, 1/3, 1/3) , a (2) = (1/12,7/12,1/3) , 

/ -10 2 4 \ 
T= 3 -7 4 

\ 2 -5 / 

Table [2] shows how the super-exponential solution (-zri to ^4) depends on the vectors a (1) 
and a (2), respectively. 



5 Supermarket Models with Multiple Choices 

In this section, we consider two supermarket models with multiple choices: The first one is 
one mobile server with multiple waiting lines under the service discipline of joint-shortest 
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Table 2: The super-exponential solution depends on the vectors a 





<* = (§, if) 


Q = f J- JL 1} 

V 12 ' 12 ' 3 ' 


Tl 


(0.0741, 0.1358 , 0.2346) 


(0.0602, 0.1728, 0.2531) 


7T2 


(5.619e-05, 1.030c-05, 1.779c-04 ) 


(7.182c-05, 2.063c-04, 3.020e-04) 


""3 


(1.411c-20, 2.587c-20, 4.469c-20) 


(1.739c-19, 4.993c-19, 7.311c-19) 


7T 4 


(1.410c-98, 2.586c-98, 4.466c-98) 


(1.444c-92, 4.148e-92, 6.074c-92) 



queue and serve-longest queue, and the second one is a supermarket model with multiple 
classes of Poisson arrivals, each of which has a choice number. Our main purpose is 
to organize the system of nonlinear equations for the fixed point under multiple choice 
numbers, and to be able to obtain super-exponential solution to the fixed points for the 
two supermarket models. 

5.1 One mobile server with multiple waiting lines 

The supermarket model is structured as one mobile server with multiple waiting lines, 
where the Poisson arrivals joint a waiting line with the shortest queue and the mobile server 
enters a waiting line with the longest queue for his service woks. Such a system is depicted 
in Figure 3 for an illustration. For one mobile server with n waiting lines, customers arrive 
at this system as a Poisson process with arrival rate nX, and all customers are served by 
one mobile server with service rate np,. Each arriving customer chooses d > 1 waiting lines 
independently and uniformly at random from the n waiting lines, and waits for service at 
a waiting line which currently contains the fewest number of customers. If there is a tie, 
waiting lines with the fewest number of customers will be chosen by the arriving customer 
randomly. The mobile server chooses / > 1 waiting lines independently and uniformly 
at random from the n waiting lines, and enters a waiting line which currently contains 
the most number of customers. If there is a tie, waiting lines with the most number of 
customers will be chosen be the server randomly. All customers in every waiting line 
will be served in the FCFS manner. We assume that all random variables defined above 
are independent of each other, and that the system is operating in the stable region 
p = < 1. Clearly, d and / are input choice number and output choice number in this 
supermarket model, respectively. 

It is clear that the stochastic environment of this supermarket model is a positive 
recurrent birth-death process with an irreducible infinitesimal generator Q = Qicft + Qright, 
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Waiting line 1 




Figure 3: A supermarket model with input and output choices 



where 



Q 



left 



o 

Li -Li 

H -li 

LI -LI 



■ J 



and 



Qright 



-A A 



-A A 



-A A 



V 



/ 



Similar derivation to those given in Section 3 or 4, we obtain that the fixed point satisfies 
the system of nonlinear equations 

7T = 1 



and 



Let 



where 



7T 0/ Qleft + ^ 0d Qright = 0. 

Qo,o u 



(53) 



Q 



V Q( £ ) 



Q 0fi = -x,u = (x,o,o,...),v = (/i,o,o,...; 
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{c) 

™ arrival 



-A A 



-A A 



-A A 



and 



Q, 



service 



H -p 

li -11 



It follows from (|53H that 



and 



7I"0 = 1, 

- Xttq + inr{ = 



"0^ ^ "£ ^arrival ^ "£ ^ service 



It follows from (EH) and (ESI) that 



7T1 = p 



Note that 



it follows from (1561) that for k > 2 



-i 





1 














1 




A' 












/' 




V 







This leads to 



*=° ■ 7 E(| 



Specifically, when d ^ f, we have 



i 



TTfc = P 



<*-/ 
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Remark 3 Equation |57| j indicates different influence of the input and output choice 
numbers d and f on the fixed point it. If d > f, then the fixed point tt decreases doubly 

k 

exponentially; and if d = f , then ir^ = pf which is geometric. However, it is very 

i 

interesting for the case with d < f. In this case, linifc_ ) . 00 ir^ = pf~ d , which illustrates that 

i 

the fraction of waiting lines with infinite customers has a positive lower bound pf~ d > 0. 
This shows that if p < 1 and d < f, this supermarket model is transient. 



5.2 A supermarket model with multiple input choices 

Now, we analyze a supermarket model with multiple input choices. There are m types of 
different customers who arrive at a queueing system of n > 1 servers for receiving their 
required service. Arrivals of customers of ith. type are a Poisson process with arrival rate 
n\i for Aj > 0, and the service times at each server are exponential with service rate 
p > 0. Note that different types of customers have the same service time. Each arriving 
customer of ith type chooses di > 1 servers independently and uniformly at random from 
the n servers, and waits for service at the server which currently contains the fewest 
number of customers. If there is a tie, servers with the fewest number of customers will be 
chosen randomly. All customers in every server will be served in the FCFS manner. We 
assume that all random variables defined above are independent of each other, and that 
the system is operating in the stable region p = Yli^i Pi < 1> where pi = Xi/p. Clearly, 
d±, c?2, • • • > d m are multiple input choice numbers in this supermarket model. 
Let 

-Aj Aj 

— Aj Aj 

— Aj Aj 



Qright (i) 



\ 



\ 



J 



and 



Qicft 




/' 



\ 



J 



Obviously, the stochastic environment of this supermarket model is a positive recurrent 
birth-death process with an irreducible infinitesimal generator Q = Qieft + YliLi Qright (*)• 



29 



Similar derivation to those given in Section 3 or 4, we obtain that the fixed point satisfies 
the system of nonlinear equations 

7T = 1 



and 



Let 



TTQleft + 7r ® dl bright (») = 0. 



1=1 



= (VT0,VT£) , 

C/i = (A*, 0,0,...), 
/ 



^arrival (^) 



- A,: Ai 



■ A,; A; 



and 



-A* 

H -fi 



\ 



■ J 



Therefore, the system of nonlinear equations (I58p and (I59p is written as 

vro = 1, 

m 



i=i 



£ 7T* (Aj, 0, 0, . . .) + E vrf^iSvai (<) + 
i=l i=l 

It follows from (EH and (EH) that 



0. 



TTl = X) ft = P> 



and from (|62j) that 

m 

7r £ = ^7r*(A i ,0,0,...) 



i=l 



-0 



i=l 



-1 



T 2_^t n C ^arrival \ 



Q 



(58) 
(59) 



(60) 
(61) 

(62) 



i=i 
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This leads to that for k > 2 

m 
i=l 

Let Si = p and 5k = YliLi ^t-iPi f° r k > 2. Then the fixed point has a super- 
exponential solution 

7T = 1 

and for k > 1 
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